avcodec/decode: validate hw_frames_ctx when AVHWAccel.free_frame_priv is used
authorDmitry Rogozhkin <dmitry.v.rogozhkin-at-intel.com@ffmpeg.org>
Tue, 21 Nov 2023 05:57:32 +0000 (21:57 -0800)
committerSebastian Ramacher <sramacher@debian.org>
Tue, 21 Nov 2023 19:52:36 +0000 (20:52 +0100)
commit709935251dc9d01ba8bed8024acdae127161850a
treea4a8f7d792b604296ae4bb295223c7ad349997de
parent1d20923b72e94fbc85c4b4d0093ecf79a4b1800f
avcodec/decode: validate hw_frames_ctx when AVHWAccel.free_frame_priv is used

Validate that a hw_frames_ctx is available before using it for
the AVHWAccel.free_frame_priv callback, and don't require it to
be present when the callback is not in use by the HWAccel.

v2: check for free_frame_priv (Hendrik)
v3: return EINVAL (Christoph Reiter)
v4: better commit message (Hendrik)
v5: fix typo with missed frames_ctx (Lynne)

See[1]: https://github.com/msys2/MINGW-packages/pull/19050
Fixes: be07145109 ("avcodec: add AVHWAccel.free_frame_priv callback")
CC: Lynne <dev@lynne.ee>
CC: Christoph Reiter <reiter.christoph@gmail.com>
Signed-off-by: Dmitry Rogozhkin <dmitry.v.rogozhkin@intel.com>
Gbp-Pq: Name 0002-avcodec-decode-validate-hw_frames_ctx-when-AVHWAccel.patch
libavcodec/decode.c